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Abstract 

This is a note to a guantum field theorist, interpreting the "Mallat" transformation (i.e., group 
invariant scattering) |l|. First the characteristics of the transformation are examined, and related 
to some well known issues with renormalization. The Lagrangian density and action for the texture 
ID problem that is the focus of Mallat is derived. This is the key translation in order to make 
the correspondence to the mathematics of quantum field theory and path integrals. Next Mallat's 
transformation is developed from the perspective of a "renormalization" of the actions. That is, 
a change of coordinates to "smoothed" paths. The effective action is then calculated utilising a 
stationary phase approximation to the usual Gaussian integrals that are encountered. It should 
be noted that this evaluation is only the leading term in an asymptotic series. The fundamental 
excitations of the system are now well identified through their relationships to the generating 
function and the corresponding currents. The resulting Feynman diagrams are presented. The 
difference between two states of the system are then quantified by excitations needed to scatter 
one state into the other. The renormalization is based on an iterative wavelet transformation where 
the wavelet family respects the group symmetries of both the base manifold and the field. Finally, 
a connection to the analysis of complex nonlinear systems will be made where the difference in 
these states of complex systems will form a natural metric. 
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Background 



Lets start with Mallat's observations about the shortcomings of Fourier and wavelet trans- 
forms While Fourier is time invariant, it is not Lifshitz continuous to small changes in 
the signal at small scales. This is just the well known ultraviolet divergence at small scales 
in renormalization. Wilson style renormalization ^\ is based on band limited Fourier trans- 
forms. Although wavelet transforms are Lifshitz continuous, they are not time invariant. 
Mallat's solution is to iteratively take wavelet transforms until the result is time invariant. 
There is a strange, but necessary, ansatz that he makes of taking the modulus between each 
wavelet transform. He orders the transformation in terms of how many wavelets are inter- 
acting (order of the interaction) and the scale of the wavelets. There is a second hierarchy 
in terms of the wavelet family. 

As a quantum field theory physicist, one has certain bells going off. Words come to mind 
like Wick ordering, invariant actions, stationary phase, and field versus space quantization. 

Since it is well known that many problems like data assimilation, finance, biology, statis- 
tical mechanics and quantum field theory can be put in a path integral formulation, we set 
out to cast Mallat's problem and method in this language. 



Translation of Mallat's problem to quantum field theory 

Mallat considers and image f{x) on deformed by r(x) such that f{x) — )■ f{x — t{x)). 
Look at this as a two dimensional field x(t) subiected to dynamical flow (hi defined by the 
vecto. fie>dg,ve„b. and suit J 



TiX 



[^f(f)-[Vf(x;) + f ]-f(f,) (1) 

and to is given by 4>to{^o) = '?{xo) and 4>o{xo) = Xo- One can define an action as 

S[x{t)] = [ " L{x{t),S{t))dt (2) 







where 

L{x{t),S{t)) = [S-T{x)]-g{x) (3) 
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and g{x) is an arbitrary gauge. In fact the flow is Hamiltonian with H{x,p) — t{x) ■ p, 
giving Hamilton's equations 



X — t{x) 

p — —p ■ ^t{x) ■ 



(4) 
(5) 



The image is just the wave function so that 




eism\/f^^[^(^t)]f{x, 0) 



(6) 



which reduces to 



/(f,i) = /(f-0i(f))=/(f-f(f)) 



(7) 



in the classical limit. Having reduced Mallat's problem to a path integral with a 2D field 
on a ID "space" coordinate, t, or base manifold; we can now move to understanding this 
transformation . 

Mallat's invariant scattering as an iterative renormalization 

For simplicity, we first consider a ID time dependent Lagrangian L{x,x,t), with a ID 
field, x(t), on a ID coordinate, t (that is, ID base manifold, M). We will generalize at the 
end to an dimensional field on a M dimensional base manifold. This will highlight why 
there is a second hierarchy associated with the wavelet family. The first hierarchy is with 
respect to the wavelet scale. To keep things tractable we will also consider the discrete time 
shced version. The action is 



j 

We now start an iterative "renormalization" by a change of coordinate to the wavelet basis 
(this will then be iterated) . The "renormalized" smoothed coordinates are 




(8) 




(9) 
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Where Wik is the mother wavelet with scale, i and time, k. This is a complex orthogonal 
transformation such that 



d{xj} 



d{xik} 

X 



ik 



(10) 

(11) 

(12) 
(13) 



ik 



In general the wavelet family should respect the group symmetries of both the base manifold 
and the field, that is symmetries of the action functional. 

The question that we now address is "what is the effective renormalized action?" We 
first recognize that due to the orthonormality of wavelet transforms that there is a simple 
mean field expression for 



dSo[{xik}] 



dL 



dL 



dxi 



ik 



dL 

dx 



ik 



d_ fdL\ 
^^A'd^J/.k 



(14) 

(15) 
(16) 



where we have used integration by parts to move the time derivative from Wl^^ to dL/dv, 
have used the definitions 



dL_ 

dx 



d_ fdL\ 



dL 



to expand M/S. and in th^wavelet basi.. and have set At = ft = i = 

get the expression for the effective action ^] by considering the generating function 



C[{Jik}] = In 



j exp I -So[{xik}] + ^ JikXik I Y\_ 

\ ik J ik 



dx 



ik 



(17) 

(18) 
1. We 

(19) 



Here Jik are the currents which generate the fundamental excitations of the system. The 
effective action is just the Legendre transform of the generating function C 



S[{vik}] = -C[{Jik}] + ^ Jik^ik 

ik 



(20) 



We separate the action into two parts S — So + Si and expand the integral in terms of 



Ipik = Xik - (fiik < <fik 



(21) 



to second order in ip 



exp[Si[{(p}]] = f exp ^^^ik -^Y^ik 



d'S. 



d(pikdipi'k 



i'k' 



Yldi/Jik 



(22) 



ik 



ik iki'k' 

This is a standard Gaussian integral that can be done but the contour must be deformed 
so that the phase of the integrand is constant. This is equivalent to taking the modulus 
of Xik, giving a natural justification to the ansatz of taking the modulus after each wavelet 
transform in Mallat's method. One gets the equation for in terms of 

d^So 



2^1 



i'k' 



dipikdifilk' 



where 



A = ln 



7 



27r 



This can be solved giving S'[{</3jfc}]. The mean path (ipik) is given by 

dS 



ik 



= 0, 



(23) 
(24) 

(25) 
(26) 



giving the expansion about {ipik) 

1 d'^S 
S = So[{{ipik)}] + 9 XI ('^^^ ~ ^"^'^"^^ 



iki'k' 



dipikdipi'k' 



i^i'k' - iVi'k')) 



+ & ^^ik - {^ik)i'\ 



(27) 
(28) 



Now as the wavelet transformation is repeated it is a conjecture that the second order 
term diagonalizes and the 3rd and higher order terms goes to zero. A way to see this is 
to assume one of the off diagonal terms is not zero. This is a statement that there is an 
interaction between two wavelets of different scales. But, this excitation is already on the 
diagonal. The same is true of the 3rd order terms. Therefore the action takes the simple 
form 

S{{^,}\ = So[{{^,)}] + I Yl ^'^"d^t"^^^ - (^p))' (29) 



Here the path, p, is specified by the order of the interaction, Ns, and a set of scales {s„}. 
In other words 

p= {Ns;si,S2,...,snJ. (30) 
In the \(pp) coordinate system, this leads to the simple form of the measure which separates 

d/i = ^ JJ exp [Sp {^p - {^p)f] d^p (31) 



Z 

p 



where 



^ _ 1 d'So 



' ~ 2 d^l 

and 



(32) 



= 0- (33) 



dip 

The dispersion relation is Sp. It also gives the energy of the fundamental excitations about 
the mean states (v?p)- These invariant actions, 5*^, characterize the dynamics specified by So 
and \(pp) is the corresponding basis. This is why Mallat's method is working so well. He is 
projecting the image onto a basis where the dynamics is diagonal and specified only by Sp. 

S-matrix, stationarity, restricted ergodicity, and the probability density function 

There is an important connection thtat we must make to the general scattering problem 
and the probability density function. We start by writing the familiar form [5] for the path 
integral propagator, U, 



f{xf,tf) = y e^°[^^'^%[{x,}]/(x„,t.) (34) 
= U{xf,tf;Xo,to)f{xo,to) (35) 

so that 

Uixf,tf,Xo,to) = y e^°[^^'^>l^[{x,}] (36) 
The scattering operator, S, or S-matrix js] jj] is defined as 

S= lim U{xf,tf;Xo,Q = lim /"e^°"^'^>]^[{a;,}]. (37) 

tf—^OD tf—^OO 

This is a unitary operator that contains all the dynamical information. 
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Now if we construct the renormalization of the path {xj} such that the wavelets have the 
same group symmetries of the base manifold and of the field (remember that an important 
part of constructing an action functional is ensuring that it has the expected symmetries of 
the field, and vice versa), it was shown in the previous section that, 

5 = lim y e^°[^^'^>l^[{xj]} = lim j e^^ff^^^^^^^[{^p}] (38) 

~ hm f e^°[<^''>] H exp [S^ - {<fp)f] d^^ (39) 

to the leading order asymptotic term. This is to say that the S-matrix is diagnalized in the 
\iPp) basis. The limit simply takes p to infinite scale or equivalently to the continuous limit 
of At — )■ 0. Sp can be identified as the invariant actions of the motion, that is the dispersion 
relation. 

We now allow f{x,t = 0) to evolve according to the dynamics for a long enough period of 
time so that the motion can ergodically visit all parts of the dynamical attractive surfaces. 
Then f{x,t oo) will have reached a stationary state foo{x). Even though the dynamics is 
not ergodic, it is ergodic in a restricted sense, that is within a \ipp) mode the time average 
will equal the field average. To be more concrete, let f{xkj) = fixkitj)) = f{x, t). Recognize 
that {fl^Pp) = fpj{k). By the restricted ergodicity fp^{k) = fp^{j), and by time stationarity 
fpkU) = fp ^ constant. Together these imply stationarity of / with respect to the field so 
that (fl^Pp) = fpkU) = fp- Eventhough the transform is with respect to the time evolution, 
one can calculate the projection of a stationary / onto \ipp) by taking the transform of 
foo{x) with respect to the field, x. The stationary wave function can be directly related to 
the probability density function, p{x) = foo{x)f^{x). Expectation values can be written as 



{A{x)) = J A{x)p{x)dx (40) 

In the classical limit 

Pi^) = ^f{xk,t = 0)f*{xk,t = 0)S{x - Xciixk,tj)). (41) 

jk 

Second quantization of the field, scattering and Feynman diagrams 

We now use this \(pp) basis to second quantize the field This is a change of basis 

to the "action" basis, sometimes called the energy basis, where the destruction operators, 



Up, and creation operators, aj, are defined such that 



t _ r 
Op, Op/ — Oppfj 

aj,0y = 0, 
[ap,ap>] = 0, 

p 

and an arbitrary state, |/), can be expanded in the basis such that 



I/) 

Ifp) 

\{Vp\f)f 
{(Pp\S\(pp) 

imf) 



n 



Mil 

{Nplf 



1/2 



EpAT/ 
So + NpSp, 



The projection of |/) onto the \(pp) basis is 

p 



(42) 
(43) 
(44) 
(45) 



(46) 

(47) 

(48) 

(49) 
(50) 



(51) 

(52) 
(53) 



where M is the modulus operator, Wx is the wavelet transform with respect to x, Wt is the 
wavelet transform with respect to t, and S{p) is Mallat's scattering operator. Note that 
we have used the results of the previous section. We can now identify {^pp\f) = S{p)fao{x) 
for the case of stationary /. Since \ipp) are the modes associated with the fundamental 
excitations of the system, a change in the projection of the wave function onto this basis 
can only be changed by an interaction with an external field. The natural metric of this 
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external interaction, scattering a state |/) into a state \g), is given by 

d'{f,9) = J2\M)-('fp\9)\" (54) 

p 

= J2\Sip)f - S{p)gf (55) 
p 

«E(^V^)'' (56) 

p 

where the proportionaUty is only valid if the total number, Np, is conserved. 

We now move on to the generahsation of this method to a dimensional field on a M 
dimensional space. We pay particular attention to the structure of the path, p. In terms of 
the space coordinate like t, the path is related to the scales of the group parameter, t. In 
this case it is an affine group, or Lie group, associated with the flow (given by the vector 
field) on phase space. It is divided into order according to how many scales have interacted, 
or in Mallat's language, how many scale scatterings have taken place. One needs to know 
the order of the path or state, Ng (that is, how many scales of which it is composed), and 
what the scales are, {s„}. 

In addition, for fields of greater than one dimension there is a second heirachy associated 
with the group of a transformation of the field. The subpath is related to the scales. A, 
of the group parameter of the field transformation. One needs to know the order of this 
substate, Nxn (that is, how many scales of which it is composed), and the scales, {Xmn}- 

To be more graphic, we call an elementary excitation of this system a genton. Its cor- 
responding creation operator is and it is indexed by p. This creation operator can be 
expanded as 

4 = 4oll^ln^ (57) 

n=l 

where Ng is the order of the state and s„ > • • • > si. The final creation operator, aj,^ is for 
an infinite scale or, in other words, for a state which has no scale interactions (that is, free). 
The excitation associated with aj^ we call an indyon. We call it this because it is associated 
with the scale of the Lie group parameter, which are independent coordinates of which the 
field is a function. We further expand the creation operator as 

4=<n«un«LA^n' (58) 

n=l m=l 
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where Nxn is the order of the subpath and XN^„n > ■ ■ ■ > Ai„. The excitation associated 
with the at x operator we call a depton. We call it this because it is associated with the 
scale of the group transformation of the field - the dependant field parameters. 

We now construct the Feynman diagram for the interaction of the two systems with states 
l/i) and 1/2). They evolve and interact according to the action 

•S" = Sol + ^Pl^li^^Pl + ^o2 + ^P2^P2^P2 + ^P^P2=P^Pl=P 

(59) 

Pl P2 P 

A simple view of the interaction is shown by the Feynman diagram in Fig. [H It is a scattering 

/l /2 




/l /2 

FIG. 1: Feynman diagram of scattering of wavefunction, /i, by another wavefunction, /2, mediated 
by a fundamental excitation, genton, of the system, or in other words a quasi-particle. 

of the state /i into /( by the emission of a genton of state p. There is a corresponding 
scattering of the state /2 into by the absorption of the same genton. 

This interaction, or scattering, can be further expanded by including the indyons, as 
shown in Figj2l Note that for this example, it is a third order scattering of this genton, 
evidenced by the emission of three indyons at once from the vertex where the genton is 
scattered from a state p to Po- 

A final expansion of this picture is yielded by including the scattering of the indyons by 
the deptons, as shown in Fig. [31 Again note the order of the indyon scattering (3, 1 and 
2 respectively) evidenced by the emission of deptons from the vertices where the indyons 
are scattered from a state s„ into Sn,o- The legend for these Feynman diagrams is shown in 
Fig.H 

These Feynman diagrams complete the connection to the language that Mallat uses. 
The elementary excitation can be viewed as scatterings. They are generated by the group 
symmetries of both the independent coordinates and the dependant fields - they are group 
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FIG. 2: Feynman diagram of the scattering of Fig. [T] expanded into the component indyons asso- 
ciated with the independent parameters of which the fields are functions. The genton is of order 
3. 

invariant scatterings. The scattering of a wave function |/) into a wave function \g) by the 
absorption of a genton of path p is given by 

\9) = al\f) (60) 

The operator aj, is simply the scattering operator of Mallat with the simple picture given 
by Fig. [51 

For the specific case of phonons, the indyons are related to quantization of the wave 
vector, k, and the depton is related to the quantization of the polarization (orientation of 
the field) The generic excitation, genton, is the the phonon. 

A more compact graphic representation of the generic excitation is shown in Fig. O It 
shows a genton with the same structure as shown in Fig. |3l Instead of each component 
excitation being shown as a line, it is reduced to a point particle. This allows the structure 
of the genton to be more easily seen. 

Conclusions 

In summary, we fell that Mallat's method can be looked upon as an iterative, wavelet 
based, renormalization. We know that this is different from what one normally thinks about 
in renormalization, but goes back to the fundamental calculation of Wilson. Wilson made a 
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All 

FIG. 3: Feynman diagram of the scattering of Fig. [1] expanded into the component deptons asso- 
ciated with the dependant field parameters. This genton is scattered by three indyons of order 3, 
1, and 2 respectively. 

change of variable to a "smoothed" coordinate using a band limited Fourier transform, and 
then calculated the "smoothed" action. He gave up on this direct approach because he did 
not have the wavelet transform (especially the iteration) in his mathematical toolbox. The 
following quote from his seminal 1971 Physics Review article is quite illuminating in that 
he stated his desire for such a set of wave packets: "This is a quantitative characterization of 
a complete orthonormal set of minimal wave packets. For quantitative purposes one would 
have to take into account tails of the wave packets which extend outside their assigned cells. 
It will he assumed here that one can divide phase space into cells of unit volume in any way 
one pleases and still he ahle to construct a corresponding set of minimal wave packets. There 
is no guarantee that this is actually possihle, and no examples of such a set of wave packets 
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genton 

indyon 
W\AAAA/VWWVWWm 

depton 



FIG. 4: Legend for feynman diagrams. 




FIG. 5: Simple single scattering of a wavefunction / into a wavefunction g by absorption of a 
genton. 



will be given here. " 

The form of the effective action is extremely simple in this basis, where only simple 
excitations need to be taken into account, no coupling. The dynamics is then specified by 
these excitation energies, or actions, Sp. This is to say, the dynamics is fully decoupled. 
These actions, Sp, are the unique finger print of the dynamics much like DNA is for a 
biological organism - it is dynamical DNA. 

Some comments on the direct relationship of this method to the language of Mallat. His 
seminal paper is entitled "Group Invariant Scattering". The basis that his transformation 
projects a probability density function onto is a basis of states that diagnalizes the scat- 
tering operator - the S-matirix. This is a unitary operator that contains all the dynamical 
information about the states. The transformation is built to respect the group symmetries 
of both the base manifold and the field. Therefore the projection of the probability density 
function onto this basis gives the occupation numbers in terms of these group symmetries. 
Two different states will therefore have a natural metric with respect to this group invariant 
scattering in terms of the number and types of fundamental excitations required to scatter 
one state into the other. This does assume that both states are governed by dynamics with 
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FIG. 6: A representation of the generic excitation, genton, made up of indyons and deptons. 

the same group symmetries. 

One may well be astonished that a general basis can diagnalize the S-matrix of any 
system. After all, the eigen basis is the solution to the dynamics. How can every problem 
have the same solution? The answer is that it does not. Remember that the wavelet family 
must respect the group symmetries of the dynamics. A very important part of constructing 
the action functional, which determines the dynamics of the system, is making sure that it 
has all the appropriate symmetries. This basis is therefore not so general, it must match 
the symmetries of your system. 

Finally, we would like to point out a major advantage of this renormalized coordinate 
system. It provides a very compact coordinate system for analyzing the dynamics of complex 
nonlinear systems. The number of important coordinates will be directly related to the 
finite dimension of the dynamical attractors, a countable finite number. The important 
coordinates will be the ones of lowest order of interaction in the hierarchy, so they will be 
easy to find. The metric that these coordinates give allows the similarity or difference of 
states to be quantified. 
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